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(57) An MPEG2 moving picture encoding/decoding system provides digital copy protection of digital moving 
picture data. The MPEG2 moving picture encoder discrete cosine transfomrts a video input 214 and uses a 
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cosine transformed video Input signal. The MPEG2 moving picture decoder removes the embedded visual 
watermark Information to locally decode the encoded video signal. 
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AH IIPE62 MOVim PICTORB EHCODIHG/DECODIHQ SYSTEM 

. The present invention can be used for a Moving 
Picture Experts Group moving picture compression/ 
5 . decompression application of motion prediction/ 
compensation based on a discrete cosine transform and 
minimizes degradation of image quality. 

This invention relates to a digital copy protection 
10 application of moving picture data which is seldom removed 
intentionally or unintentionally by a user except an 
author, and more particularly, relates to an MPE62 moving 
picture encoder /decoder. 

15 The MPEG2 standard is a con^ression/decon^ression 

standard for video applications, and exploits temporal 
redundancy for motion compensated interpolated and 
predicted encoding. That is, the assumption is made that 
"locally'' the current picture can be modeled as a 

20 translation of the picture at a previous and/or future 
time. ''Locally" means that the amplitude and direction of 
the displacement are not the same everywhere in the 
picture. 

25 The MPEG2 standard specifies predicted and 

interpolated interframe encoding and spatial domain 
intraframe encoding. It has block based motion 
coii5>ensation for the reduction of ten?)oral redundancy, and 
block based Discrete Cosine Transform based on compression 

30 for the reduction of spatial redundancy. 

The information relative to motion is based on a 
16x16 array of pixels and is transmitted with the spatial 
information. Motion information is compressed with 
35 variable length codes, such as Huffman codes.. 
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Recently, audio/ video information expressed as 
digital information is becoming more widely used and a 
method utilizing digital products also has been increasing 
accordingly as digitalization of the A/V application and 
5 popularity of the internet have been increasing rapidly. 

Specifically anybody who is able to use a PC can 
copy/edit digital products easily and accordingly a social 
issue of illegal copying has been raised. A watermark 
10 technique has become prominent as a solution to prevent 
this problem. 

There are two exen^lary methods for providing copy 
protection of digital A/V data to prevent illegal copying. 
15 The first method is encryption, i.e., a copy protection 
method by scrambling the digital information. The second 
method is a digital watermark method with the purpose of 
preventing the illegal use of digital information. 

The first method is a technique for prevention of 
illegal copying of digital A/V data, by providing 
descraunble information and password information capable of 
accessing and running the A/V product only in the case 
that the A/V product is bought legally. . 

The second method is a technique which utilizes 
self-restraint by a user to not produce an illegal copy of 
the A/V product by embedding ID information or a logo in 
a state of noise into A/V contents data of the A/V product 
for the purpose of forbidding the illegal or commercial 
use of digital information. The watermark technique is 
used on the original image and is invisible to a person 
who would copy it, but the author can prove that the 
copied image is his by virtue of an arbitrary reverse 
processing. 
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For example, in a case where a counterfeiter forges 
money using a colour copier, a vignette on the original 
bill turns clear by copying the bill, and consequently it 
makes it virtually in5>ossible to copy bank note. This is 
5 called a visible watermark. 

Also, in the case where a spy writes a message onto 
paper with salt water, other people will think this is an 
ordinary blank piece of paper, but this paper is a medium 
10 having an iiq>ortant information for the spy - because he 
can see the message anytime he wants to by heating the 
paper. In this case, we call it an invisible watermark. 

At present, the watermark technique is used for 
15 digital still images or audio, i.e., putting the message 
distinguishable from the original image into the image. 
Therefore, in the case that an author's own image 
circulates illegally, the image can be proved to be that 
of author by performing an arbitrary reverse processing. 

20 

Thus, techniques for preventing the illegal copying 
of digital product are increasingly being studied these 
days. 

25 Figures 1 and 2 illustrate a conventional MPE62 

moving picture encoder and decoder respectively. Figure 3 
illustrates a structure of a video picture used in the 
MPEG2 moving picture encoder/decoder and. Figure 4 
illustrates three types of pictures and their relationship 

30 under the MPEG2 standard. We will explain the conventional 
MPEG2 moving picture encoder and decoder by referring to 
these figures. 

One picture can be divided into uniformly sized 
35 regular square areas and each area is transformed. 



1 
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Therefore, the image is divided into image ingredients of 
different frequencies from an average value (DC value) to 
an image ingredient value of an extremely high frequency • 
This division process is called an orthogonal 
5 transformation and the orthogonal transformation is a 
discrete cosine transform (DCT). 

Orthogonal transformations, because they have a 
frequency domain interpretation, are filter bank oriented. 
10 The discrete cosine transfom is also localized. That is, 
an encoding process illustrates samples on an B^S spatial 
window which is sufficient to compute 64 transform 
coefficients or sub-bands. 

15 Another advantage of the discrete cosine transform 

is that fast encoding and decoding algorithms are 
available. Additionally, the sub-band decomposition of the 
discrete cosine transform is sufficiently well behaved to 
allow effective use of psychovisual criteria. 

20 

After the discrete cosine transform, many of the 
higher frequency coefficients are zero. These coefficients 
are organized into a zigzag, as illustrated in Figure 5, 
and converted into run-amplitude (run-level) pairs. Each 
25 pair indicates the number of zero coefficients. This is 
coded in a variable length code. 

Discrete cosine transform encoding is carried out in 
the three stages as illustrated in Figure 5. The first 

30 stage is the computation of the discrete cosine transform 
coefficients. The second stage is the quantization of the 
coefficients. The third stage is the conversion of the 
quantized transformation coefficients into run-amplitude 
pairs after reorganization of the data into a zigzag 

35 scanning order. 
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Quantization can be viewed as a shift to the right 
by several bits. Quantization enables a very high degree 
of compression, and a high output bit rate, and retains 
high picture quality. Quantization can be adaptive with I 
5 picture having fine quantization to avoid "blockiness" in 
the reconstructed image. This is important because I 
pictures contain energy at all frequencies. By way of 
contrast, P and B pictures contain predominately high 
frequency energy and can be coded at a coarser 
10 quantization. 

One challenge facing decoder designers is the 
accommodation of a single decoder system to a variety of 
display output formats, while complying fully with 

15 luminance/chrominance relationships and the MFE62 
standard. The displayed output of the decoder chip must 
conform to Consultative Committee International Radio 
(CCIR) recommendation 601. This specifies the number of 
luminance and chrominance pixels in a single active line, 

20 and also how the chrominance pixels are subsampled 
relative to the luminance signals. 

: The format defined as 4: 2: 2 is supported in most 
cases in industry. This defines 720 active luminance 

25 signals, and. 360 colour differentiated signals, where each 
line of luminance signals has a corresponding line of 
chrominance signals. CCIR recommendation 656 goes on to 
define the number of active lines for National Television 
System Committee (NTSC) and Phase Alternation by Line 

30 (PAL) environments as 480 and 576, respectively. The 
contents as noted above are disclosed in U. S. Pat. No. 
5,668,599. 

An MPEG2 moving picture encoder 100 performs an 
35 encoding method by utilizing the cooperation of an 



- 6 - 

intracoding method on the spatial domain and an 
intercoding method on the temporal domain. The MPEG2 
moving picture encoder 100 performs the intracoding method 
on the spatial domain by compressing the original image 
5 into a variable length coding of a Huffman code through a 
DCT 114 and a quantizer 116 and transmits the variable 
length code* 

The MPE62 moving picture encoder 100 performs the 
10 intercoding method on the temporal domain by decoxi^ressing 
the I picture compressed on the spatial domain through a 
dequantizer 122 and an Inverse Discrete Cosine Transform 
(IDCT)^ and predicts by comparing the compressed I picture 
with the image being inputting at present through a frame 
15 memory 128 and an adaptation estimator 130^ and then 
encodes a difference signal with the original signal by 
compensating motion^ i.e., spatial-shifting the image 
being input at present as much as the predicted motion. 

20 In the case that a method predicting motion is 

forward prediction, we call it a P picture and in case 
that a method predicting motion contains all of forward 
and backward predictions, we call it a B picture. 
Accordingly motion prediction and compensation of P and B 

25 images are affected by the picture accuracy coded as an I 
picture- So, in the decoding process decoding the encoded 
image, first, the I picture must be decoded exactly so 
that the P and B images, to which the difference signals 
are transmitted, can be decoded accurately. 

30 

But even through the use of the copy preventing 
technique by encryption and scrambling as noted above, it 
is possible to easily copy data when duplication and key 
data are known. And also the watermark technique for 
35 moving picture data has some problems which can reduce 



encoding efficiency by embedding ID information and a logo 
in the form of noise. 

The picture structure of an MPEG2 moving picture 
encoding method, as illustrated in Figure 4, includes 
intraframe (I picture) reducing spatial redundancy 
information of image information, a predicted frame (P 
picture) reducing interrelation between frames through 
forward prediction, and an interpolated frame (B picture) 
reducing between frames through bidirection prediction. 

Therefore, in decoding of the image signal, only in 
the case where the decoded previous I picture exists, can 
the P picture be decoded perfectly through motion 
condensation, and only in the case where the decoded I and 
P pictures are used in B picture prediction in the 
encoding process, can the B picture be decoded through 
motion decoding. 

Up to now, digital watermark information discrete- 
cosine-transfonned in the form of noise is embedded into 
an original image and an I picture codes this digital 
watermark information. 

And it is used as a reference in the case of 
predicting motion of the P and B pictures according to 
encoding locally the I picture. Consequently there is a 
problem of an error while estimating motion of the P and 
B pictures by the mixed watermark information. 

Because the watermark technique for still images, 
which has started to be studied recently as noted above, 
includes watermark data on the spatial domain,, the 
watermark technique is not suitable for MPEG encoding 
method conqpressing data by removing redundancy information 
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in accordance with using interrelation of data on the 
spatial domain and the temporal domain. 

That is, in case the image quality of the image that 
5 contains the watermark deteriorates conspicuously in 
coir^arison with the image quality where the watermark 
information is not contained, the meaning can be lost 
because the image can deteriorate even though the original 
object contains watermark information. 

10 

Thus, the image containing the watermark has to 
appear very similar to image which does not contain the 
watermark information. 

15 It as an aim of embodiments of the present invention 

to solve or reduce the above-noted problems and can be 
used by MPEG moving picture con5)ression/decompression 
applications of motion prediction/compensation based on 
the discrete cosine transform. 

20 

Accordingly, it is an aim of embodiments of the 
invention to provide a digital copy protection apparatus 
of moving picture data that makes it difficult to get rid 
of watermark information by a user except an author, in 
25 accordance with maximizing degradation of pixel. 

A second aim of embodiments of the present invention 
is to provide an MPEG2 moving picture encoder and a third 
object of the present invention provides an MPEG2 moving 
30 picture decoder. 

Also, a fourth aim is to provide an MPEG2 moving 
picture encoding/decoding system with the encoder and the 
decoder. 



- 9 - 

Additional objects and advantages of the invention 
will be set forth in part in the description which follows 
and, in part, will be obvious from the description, or may 
be learned by practice of the invention. 

5 

According to a first aspect of the invention, there 
is provided an MPEG2 moving picture encoder to encode a 
video signal with digital watermark information and 
including a frame memory, a frame/field memory, an 

10 activity calculator, a rate controller, a Discrete Cosine 
Transform (DCT) unit, a quantizer, a deguantizer, an 
Inverse Discrete Cosine Transform (IDCT) unit, an 
adaptation estimator, a motion estimator, a variable 
length coder and multiplexer (VLC & a MUX) and a buffer, 

15 the MPEG2 moving picture encoder con^rising: a Discrete 
Cosine Transform (DCT) unit to discrete-cosine-transform 
the digital watermark information; a digital watermark 
inserter installed between said DCT and said VLC & MUX, to 
embed the digital watermark information discrete-cosine- 

20 transformed by said DCT on a frequency domain of the video 
signal; and a digital watermark r^nover, installed between 
said dequantizer and said IDCT, to remove digital 
watermark information on a spatial domain of the DCT 
embedded, so as to prevent an error during estimating 

25 motion on a ten^oral domain for P and B pictures of the 
video signal. 

Said digital watermark inserter is preferably located 
between said DCT and quantizer. 

30 

Said digital watermark inserter is preferably located 
between said quantizer and said VLC & MUX. 
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Said DCT unit may use an 8x8 DCT to embed the 
watermark information on the frequency domain of the video 
signal. 

5 Said IDCT preferably prevents an error of a temporary 

domain coding by watermark. 

According to a second aspect of the invention, there 
is provided an MPE62 moving picture decoder to decode an 

10 encoded bit stream conprising: a first buffer to receive 
and save the encoded bit stream; a variable length decoder 
and demultiplexer (VLD & a DEMUX) to receive the encoded 
bit stream from said first buffer and to variable-length- 
decode the encoded bit stream; a deguantizer to dequantize 

15 the variable length decoded signal from said VLD & DEMUX; 
a digital watermark remover to remove a digital watermark 
embedded in the dequantized signal to locally decode by 
reading watermark information and information from said 
dequantizer, to generate a dequantized signal without the 

20 digital watermark; a first Inverse Discrete Cosine 
Transform (IDCT) unit to inverse-discrete-cosine- trans form 
the dequantized signal without the digital watermark from 
said watermark remover, to generate a first IDCT signal; 
a digital watermark inserter to embed again the watermark 

25 removed by said digital watermark remover in the 
dequantized signal without the digital watermark for 
performing local decoding; a second IDCT unit to inverse- 
discrete-cosine-transfprm the signal from said watermark 
inserter, to generate a second IDCT signal; a first adder 

30 to add the second IDCT signal from said second IDCT unit 
and motion compensation data, to generate a first added 
signal; a second buffer to temporarily save the first 
added signal and output the first added signal so that the 
first added signal is replayed; a multiplexer (MUX) to 

35 multiplex a first saved signal, a second saved signal, a 
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third signal having a predetermined value and a fourth 
signal to output a multiplexed signal, to generate a 
second added signal, the second added signal being the 
motion compensation data; a previous picture store block 
5 to teii5)orarily save the second added signal and the second 
saved signal to generate the first saved signal; a future 
picture store block tenqporarily save the second added 
signal and to transmit the saved second added signal to 
said previous picture store block and said multiplexer as 
10 the second saved signal; and a multiplier by 1/2 means for 
multiplying by 0.5 the first and second saved signals, to 
generate the fourth signal. 

Preferably, said digital watermark remover prevents 
15 an error of the temporal domain coding by the digital 
watermark. 

Preferably, the digital watermark embedded by the 
watermark inserter I-picture-codes or P-picture-codes , and 
20 said dequantizer deguantizes it, and then said digital 
watermark remover r^noves it, in order to prevent the 
error of said tenqporal domain coding. 

Said digital watermark remover is preferably arranged 
25 to correctly predict the motion information. 

Preferably, the watermark, embedded by the watermark 
inseirter within said moving picture encoder I-picttire- 
codes or P-picture-codes, and said dequantizer deguantizes 
30 it, and then said digital watermark remover removes it, in 
order to predict correctly the motion information. 

The decoder preferably receives the watermark from a 
recording medium. 
35 The recording medium is preferably a disk. 
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The watermark is preferably embedded into a domain, 
such as a lead-in domain, which a user cannot access 
directly and the correct motion restoration is performed 
5 by reference to it when embedding and decoding said 
watermark. 

Said decoder preferably has the function to decrease 
encoding efficiency by embedded digital watermark 
10 information. 

Said decoder for carrying out said function 
preferably decreases an error while predicting motion of 
P and B pictures by embedded digital watermark 
15 information. 

Said decoder preferably has the function of 
preventing degradation of image quality by embedded 
digital watermark information. 

20 

Said decoder for carrying out said function 
preferably decreases an error while predicting motion of 
P and B pictures by embedded digital watermark 
information. 

25 

According to a third aspect of the invention, there 
is provided an MPEG2 moving picture encoding /decoding 
system which processes a video input signal of MPEG2 
moving picture data, the system comprising: an MPEG2 

30 moving picture encoder, encoding a video input signal, 
said encoder comprising copy protection means for 
embedding a watermark into the encoded video signal, to 
generate an encoded bit stream; and an MFEG2 moving 
picture decoder, to decode the encoded bit stream from 

35 said moving picture encoder, said decoder conqprising means 
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for replaying perfectly the MPEG2 moving picture data of 
the decoded bit stream into which the watermark is 
embedded. 

5 Said copy protection means preferably comprises: a 

Discrete Cosine Transform (DCT) unit to discrete cosine 
transform the video input signal and the watermark; a 
digital watermark inserter to embed the watermark 
discrete-cosine-transformed by said DCT unit on a 

10 frequency domain of the discrete cosine transformed video 
input signal; a digital watermark remover for removing 
digital watermark information on the spatial domain of the 
DCT embedded for preventing an error while predicting 
motion for a P and B picture, the remover being installed 

15 between dequantizer the IDCT on the temporal domain. 

Said digital watermark inserter is preferably located 
between said DCT and qpiantizer. 

20 Said digital watermark inserter is preferably located 

between said quantizer and said VLC & MUX. 

Said digital watermark inserter preferably uses 8x8 
DCT to insert said watermark on the frequency domain. 

25 

Said IDCT preferably prevents an error of temporary 
domain coding by watermark. 

Said means of replaying perfectly the MFEG2 moving 
30 picture data of the decoded bitstream, in which the 
watermark is embedded, preferably con^rises the digital 
watermark remover, to prevent an error of ten^ral domain 
coding by said watermark. 

Preferably, the watermark embedded by the digital 
35 watermark inserter within said moving picture encoder I- 
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picture-codes or P-picture -codes and said dequantizer 
dequantizes it^ and then said digital watermark remover 
removes it^ in order to prevent the error of said ten^oral 
domain coding* 

5 

Preferably, said digital watermark remover correctly 
predicts the motion information, 

Preferably, the watermark embedded by the watermark 
10 inserter within said moving picture encoder I-picture- 
codes or P-picture-codes and said dequantizer dequantizes 
it, and then said digital watermark remover removes it, in 
order to predict exactly said motion information 

15 The MPEG2 moving picture decoder preferably receives 

the watermark from a recording medium. 

Said recording medium is preferably a disk. 

20 Said watermark is preferably embedded into a domain, 

such as a lead-in domain, where a user cannot access 
directly and the correct motion restoration is performed 
by reference to it when embedding and decoding said 
watermark. 

25 

Said decoder may decrease encoding efficiency by 
embedded digital watermark information. 

Said decoder for carrying out said function 
30 preferably decreases an error while predicting motion of 
a P and B pictures by embedded digital watermark 
information. 

Said decoder preferably prevents degradation of image 
35 quality by embedded digital watermark information. 
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Preferably, said decoder for carrying out said 
ftmction decreases the error while predicting motion of 
the P and B pictures by embedded digital watermark 
5 information. 

For a better understanding of the invention, and to 
show how ^nbodiments of the same may be carried into 
effect, reference will now be made, by way of example, to 
10 the acconpanying diagrammatic drawings, in which: 

Figure 1 shows a conventional MBEG2 moving picture 
encoder; 

15 Figtire 2 shows a conventional MPE62 moving picture 

decoder; 

Figure 3 shows a structure of the video picture used 
in a conventional MPEG2 moving picture encoder /decoder; 

20 

Figure 4 shows three types of pictures and their 
relationship under the MPE62 standard, i.e., I pictures, 
P predicted pictures, and B bidirectionally predicted 
pictures ; 

25 

Figure 5 shows a sequence wherein discrete cosine 
transform coefficients are calculated and mixed and the 
discrete cosine transform coefficients are quantized in a 
zigzag manner; 

30 

Figure 6 shows a block diagram of an MPE62 moving 
picture encoder according to an embodiment of the present 
invention; and 
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Figure 7 shows a block diagram of an MPEG2 moving 
picture decoder according the embodiment of the present 
invention. 

5 While the invention is susceptible to various 

modifications and alternative forms, specific eit±>odiments 
thereof have been shown by way of example in the drawings 
and will herein be described in detail. It should be 
understood, however, that it is not intended to limit the 
10 invention to the particular forms disclosed, but on the 
contrary, the intention is to cover all modifications, 
equivalents, and alternatives falling within the scope of 
the invention as defined by the appended claims. 

15 Figure 6 illustrates a block diagram of an MPEG2 

moving picture encoder 200 according to an embodiment of 
a first aspect of the present invention and Figure 7 
illustrates a block diagram of an MPEG2 moving picture 
decoder 245 according to an embodiment of a second aspect 

20 of the present invention. 

In Figure 6, the HFEG2 moving picture encoder 
includes a frame memory 210, a frame/field memory 212, a 
subtracter 234, a DCT unit 214, a digital watermark 

25 inserter 240, a quantizer 216, an activity calculator 218, 
a rate controller 220, a dequantizer 222, a digital 
watermark remover 242, an IDCT unit 224, an adder 226, a 
frame memory 228, an adaption estimator 230, a motion 
estimator 232, a VLC & MUX 236, and a buffer 238. The 

30 frame memory 210, frame/field memory 212, subtracter 234, 
DCT unit 214, quantizer 216, activity calculator 218, rate 
controller 220, dequantizer 222, IDCT unit 224, adder 226, 
frame memory 228, adaption estimator 230, motion estimator 
232, VLC & MUX 236 and buffer 238 operate in the same 

35 fashion as the frame memory 110, frame/field memory 112, 
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DCT 114, quantizer 116, activity calculator 118, rate 
controller 120, deguantizer 122, IDCT 124, adder 126, 
frame memory 128, adaption estimator 130, motion estimator 
132, VLC & MUX 136 and buffer 138, respectively, shown in 
5 Figure 1 and previously described. 

The digital watermark inserter 240 makes digital 
watermark information not removable by a user except an 
author and is embedded on a frequency domain 8x8 discrete** 

10 cosine-transformed of the encoded video signal, in order 
to reduce the burden on hardware. That is, the process of 
the digital watermark insertion by the digital watermark 
inserter ,240 embeds the watermark information on the 
frequency domain, so that a duplicator cannot edit or 

15 res^ve a digital product illegally and arbitrarily. 

Referring to Figure 6, the digital watermark 
inserter 240 is located between the DCT unit 214 and a VLC 
and a MUX 236 and is also located between the DCT unit 214 
20 and the quantizer 216. It is preferable that the digital 
watermark inserter 240 is located immediately between the 
DCT 214 and the quantizer 216 for reasons of visual 
effect. 

25 Because basically the MPE62 standard embodies a 

frequency domain processing on the discrete cosine 
transform, the DCT \init 214 of Figure 6 discrete-cosine- 
transforms the digital watermark information, and then the 
digital watermark inserter 240 embeds it. The watermark 

30 information, is embedded and processed in the digital 
watermark inserter 240 and then is added to an original 
image. 



Thus, the watermark information embedded on the 
35 frequency domain is quantized in the quantizer 216 and is 
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variable-length-coded in the VLC & MUX 236. This is I 
picture coding process. 

The dequantizer 222 dequantizes the I or P-picture 
5 coded data in which the watermark information is embedded 
and a digital watermark remover gets rid of the embedded 
watermark information. An IDCT unit 224 reverse-discrete- 
cosine-transforms the I or P-picture coded data for 
estimating correctly the motion information. Therefore, 

10 the HPE62 moving picture encoder 200 prevents an error of 
a temporal domain coding by the watermark information. The 
HPEG2 moving picture encoder 200 compensates for the error 
by estimating an image motion that is being input at 
present from the I or P picture restored like this, and 

15 then codes a difference signal. 

In this instance, the watermark information is 
embedded on the spatial domain in the back of said DCT. 
The digital watermark inserter 240 embeds the digital 
20 watermark information only on the spatial domain of the 
discrete cosine transform. 

The digital watermark remover removes the digital 
watermark information on the spatial domain of the 
25 discrete cosine transform which was embedded for 
preventing the error during the motion estimation on the 
temporal domain for P and B pictures by using the embedded 
digital watermark information. 

30 Figure 7 illustrates the MPEG2 moving picture 

decoder 245 to correctly decode an MPEG2 video stream 
including the digital watermark information embedded as in 
the MPEG2 moving picture encoder 200 shown in Figure 6. 
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The MPEG2 moving picture decoder includes a first 
buffer 250, a VLD & DEMUX 252, a dequantizer 254, a 
digital watermark remover 270, a first DCT 256, an adder 
260, a previous picture store block 262, future picture 
5 store block 264, an adder 266, a multiplier by 1/2 268, 
operate in the same function as the first buffer 150, VLD 
& DEMUX 152, dequantizer 154, IDCT 156, adder 160, 
previous picture store block 162, future picture store 
block 164, adder 166, and a multiplier by 1/2 168, 
10 respectively, shown in Figure 2 and described above. The 
digital watermark remover 220 removes the watermark 
information embedded on the spatial domain of the discrete 
cosine transform while restoring motion of the P and B 
pictures . 

15 

The MPEG2 moving picture decoder 245 performs 
operations in the reverse order of the MPEG2 moving 
picture encoder 220. 

20 Accordingly in the MPEG2 moving picture decoder 245, 

the watermark information embedded in the encoder has to 
be transmitted. 

In the case that an encoded MPEG video stream is- 
25 transmitted through a storage medium such as a disk, it is 
possible to perfectly restore motion, referring to it 
while decoding by embedding the watermark on a lead-in 
domain which the user cannot access directly. 

30 The digital watermark apparatus according to 

embodiments of the present invention for preventing the 
illegal copy of MPEG2 moving picture data makes it 
possible to prevent degradation of the image quality and 
efficiency reduction of encoding by the embedded digital 

35 watermark information by decreasing the error while 
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estimating motion of the P and B pictures by using the 
embedded digital wateirmark information • 

In the case of decoding locally for compensating 
5 motion,, once the embedded watermark information is removed 
while encoding the I or P picture^ and it is decoded 
locally, and then it is used as data for motion 
compensation while decoding the P and B pictures. 

10 And in case of decoding for the decoding output, the 

HPEG2 moving picture decoder 221 again embeds the 
watejnnark infoinnation that had been removed once for 
decoding locally , and reverse-discrete-cosine-transforms 
the embedded watermark information, and then adds motion 

15 compensation data thereto. 

Conclusively the image in which the watermark 
information is embedded is replayed perfectly • Further, 
there is an effect of decreasing degradation of the image 
20 quality to a maximum extent by restraining an increase of 
encoding information according to the organization of the 
invention as noted above, and that the watermark 
information is not removed easily by a user, except an 
author • ■ 

25 

The reader's attention is directed to all papers and 
documents which are filed concurrently with or previous to 
this specification in connection with this application and 
which are open to public inspection with this 
30 specification, and the contents of all such papers and 
documents are incorporated herein by reference. 

All of the features disclosed in this specification 
(including any accompanying claims, abstract and 
35 drawings), and/or all of the steps of any method or 
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process so disclosed^ may be combined in any combination, 
except combinations where at least some of such features 
and/or steps are imitually exclusive. 

5 Each feature disclosed in this specification 

(including any accompanying claims r abstract and 
drawings ) , may be replaced by alternative features serving 
the same, equivalent or similar purpose, unless expressly 
stated otherwise. Thus, unless expressly stated 
10 otherwise, each feature disclosed is one exasple only of 
a generic series of equivalent or similar features • 

The invention is not restricted to the details of the 
foregoing embodiment ( s ) • The invention extends to any 
15 novel one, or any novel combination, of the features 
disclosed in this specification (including any 
accompanying claims, abstract and drawings), or to any 
novel one, or any novel combination, of the steps of any 
method or process so disclosed. 



20 



- 22 - 



CLAIMS 

1. An MPEG2 moving picture encoder to encode a video 
signal with digital watermark information and including a 
frame memory, a frame/field memory, an activity 

5 calculator, a rate controller, a Discrete Cosine Transform 
(DCT) unit, a quantizer, a dequantizer, an Inverse 
Discrete Cosine Transform (IDCT) unit, an adaptation 
estimator, a motion estimator, a variable length coder and 
multiplexer (VLC & a MUX) and a buffer, the MPEG2 moving 
10 picture encoder comprising: 

a Discrete Cosine Transform (DCT) unit to discrete- 
cosine-transform the digital watermark infojrmation; 

15 a digital watermark inserter installed between said 

DCT and said VLC 6 MUX, to embed the digital watermark 
information discrete-cosine-transformed by said DCT on a 
frequency domain of the video signal; and 

20 a digital watermark remover, installed between said 

dequantizer and said IDCT, to remove digital watermark 
information on a spatial domain of the DCT embedded, so as 
to prevent an error during estimating motion on a temporal 
domain for P and B pictures of the video signal. 

25 

2, The MPEG2 moving picture encoder as set forth in 
claim 1, wherein said digital watermark inserter is 
located between said DCT and quantizer. 

30 3- The MPEG2 moving picture encoder as set forth in 
claim 1, wherein said digital watermark inserter is 
located between said quantizer and said VLC & MUX. 

4. The MPEG2 moving picture encoder as set forth in any 
35 of claims 1 to 3, wherein said DCT unit uses an 8x8 DCT to 
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embed the watermark information on the frequency domain of 
the video signal. 

5. The MPE62 moving picture encoder as set forth in any 
5 of claims 1 to 4, wherein said IDCT prevents an error of 

a temporary domain coding by watermark. 

6. An MPE62 moving picture decoder to decode an encoded 
bit stream comprising: 

10 

a first buffer to receive and save the encoded bit 
stream; 

a variable length decoder and demultiplexer (VLD & a 
15 DEMUX) to receive the encoded bit stream from said first 
buffer and to variable-length*decode the encoded bit 
stream; 

a deguantizer to dequantize the variable length 
20 decoded signal from said VLD & DEMUX; 

a digital watermark remover to remove a digital 
watermark embedded in the dequantized signal to locally 
decode by reading watermark information and information 
25 from said dequantizer, to generate a dequantized signal 
without the digital watermark; 

a first Inverse Discrete Cosine Transform (IDCT) unit 
to inverse-discrete-cosine-transform the dequantized 
30 signal without the digital watermark from said watermark 
remover r to generate a first IDCT signal; 



a digital watermark inserter to embed again the 
watermark removed by said digital watermark remover in the 
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dequantized signal without the digital watermark for 
performing local decoding; 

a second IDCT unit to inverse-discrete-cosine- 
transform the signal from said watermark inserter, to 
generate a second IDCT signal; 

a first adder to add the second IDCT signal from said 
second IDCT unit and motion condensation data, to generate 
a first added signal; 

a second buffer to tenqporarily save the first added 
signal and output the first added signal so that the first 
added signal is replayed; 

a multiplexer (MUX) to multiplex a first saved 
signal, a second saved signal, a third signal having a 
predetermined value and a fourth signal to output a 
multiplexed signal, to generate a second added signal, the 
second added signal being the motion compensation data; 

a previous picture store block to ten5>orarily save 
the second added signal and the second saved signal to 
generate the first saved signal; 

a future picture store block ten^Ksrarily save the 
second added signal and to transmit the saved second added 
signal to said previous picture store block and said 
multiplexer as the second saved signal; and 

a multiply by 1/2 means for multiplying by 0.5 the 
first and second saved signals, to generate the fourth 
signal. 
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?• The MPEG2 moving picture decoder as set forth in 
claim 6r wherein said digital watermark remover prevents 
an error of the ten^ral domain coding by the digital 
watermark. 

5 

8. The MPEG2 moving picture decoder as set forth in 
claim 6 or 7^ wherein the digital watermark embedded by 
the watermark inserter I -picture-codes or P-picture-codes , 
and said deguantizer dequantizes it, and then said digital 

10 watexnnark remover removes it, in order to prevent the 
error of said ten^ral domain coding. 

9. The MPE62 moving picture decoder as set forth in 
claim 6, 7 or 8, wherein said digital watermark remover 

15 correctly predicts the motion information. 

10. The MPEG2 moving picture decoder as set forth in 
claim 8, wherein the watermark, embedded by the watermark 
inserter within said moving picture encoder I-picture- 

20 . codes or P-picture-codes, and said deguantizer dequantizes 
it, and then said digital watermark remover removes it, in 
order to predict correctly the motion information. 

11. The HPEG2 iMving picture decoder as set forth in 
25 claim 6, wherein the decoder receives the watermark from 

a recording medium. 

12. The MPEG2 moving picture decoder as set forth in 
claim 11, wherein the recording medium is a disk. 

30 

13. An MPE62 moving picture decoder as set forth in 
claims 11, wherein the watermfurk is embedded into a domain 
which a user cannot access directly and the correct motion 
restoration is performed by reference to it when embedding 

35 and decoding said watermark. 
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14. The MPEG2 moving picture decoder as set forth in 
claim 13, wherein the domain, which a user cannot access 
directly, is a lead-in domain. 

5 

15. The MPEG2 moving picture decoder as set forth in any 
of claims 6 to 14, wherein said decoder has the function 
to decrease encoding efficiency by embedded digital 
watermark information. 

10 

16. The MPEG2 moving picture decoder as set forth in 
claim 15, wherein said decoder for carrying out said 
function decreases an error while predicting motion of P 
and.B pictures by embedded digital watermark information. 

15 

17. The MPEG2 moving picture decoder as set forth in 
claim 6, wherein said decoder has the function of 
preventing degradation of image quality by embedded 
digital watermark information. 

20 

18- The MPEG2 moving picture decoder as set forth in 
claim 17, wherein said decoder for carrying out said 
function decreases an error while predicting motion of P 
and B pictures by embedded digital watermark information. 

25 

19. An MPEG2 moving picture encoding/decoding system 
which processes a video input signal of MPEG2 moving 
picture data, the system comprising: 

30 an MPEG2 moving picture encoder, encoding a video 

input signal, said encoder comprising copy protection 
means for embedding a watermark into the encoded video 
signal, to generate an encoded bit stream; and 



- 27 - 



an HPE62 moving picture decoder, to decode the 
encoded bit stream from said moving picture encoder, said 
decoder con?)rising means for replaying perfectly the HPEG2 
moving picture data of the decoded bit stream into which 
5 the watermark is embedded* 

20. The MPE62 moving picture encoding/decoding system as 
set forth in claim 19, wherein said copy protection means 
coziprises : 

10 

a Discrete Cosine Transform (OCT) unit to discrete 
cosine transform the video input signal and the watermark; 

a digital watermark inserter to embed the watermark 
15 discrete-cosine-transformed by said DCT unit on a 
frequency domain of the discrete cosine transformed video 
input signal; 

a digital watermark remover for removing digital 
20 watermark information on the spatial domain of the DCT 
embedded for preventing an error while predicting motion 
for a P and B picture, the remover being installed between 
dequantizer the IDCT on the teiq»oral domain* 

25 21. The MPEG2 moving picture encoding/decoding system as 
set forth in claim 20, wherein said digital watermark 
inserter is located between said DCT and gueuitizer. 

22. The MPEG2 moving picture encoding/ decoding system as 
30 set forth in claim 20, wherein said digital watermark 

inserter is located between said quantizer and said VLC & 
MUX. 

23. The HPEG2 moving picture encoding/decoding system as 
35 set forth in claim 21, wherein said digital watermark 
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inserter uses 8x8 DCT to insert said watermark on the 
frequency domain. 

24. An MPEG2 moving picture encoder ing/decoding system 
as set forth in claim 20, wherein said IDCT prevents an 
error of temporary domain coding by watermark. 

25. The HPEG2 moving picture encoding /decoding system as 
set forth in claim 19, wherein said means of replaying 
perfectly the MPEG2 moving picture data of the decoded 
bitstream, in which the watermark is embedded, comprises 
the digital watermark remover, to prevent an error of 
texi^ral domain coding by said watermark. 

26. The MPEG2 moving picture encoding /decoding system as 
set forth in cladLm 25, wherein the watermark embedded by 
the digital watermark inserter within said moving picture 
encoder I-picture-codes or P-picture-codes and said 
dequantizer dequantizes it, and then said digital 
watermark remover removes it, in order to prevent the 
error of said temporal domain coding. 

27. The MPEG2 moving picture encoding/decoding system as 
set forth in claim 26, wherein said digital watermark 
remover correctly predicts the motion information. 

28. The MPEG2 moving picture encoding/decoding system as 
set forth in claim 27, wherein watermark embedded by the 
watermark inserter within said moving picture encoder I- 
picture-codes or P-picture-codes and said dequantizer 
dequantizes it, and then said digital watermark remover 
removes it, in order to predict exactly said motion 
information 
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29. The MPE62 moving picture encoding/decoding syst^ as 
set forth in claim 28, wherein the MPE62 moving picture 
decoder receives the watermark from a recording medium. 

5 30. The MPEG2 moving picture encoding/decoding system as 
set forth in claim 29, wherein said recording medium is a 
disk. 

31. The HPEG2 moving picture encoding/decoding system as 
10 set forth in claim 29, wherein said watermark is embedded 
into a domain where a user cannot access directly and the 
correct motion restoration is performed by reference to it 
when embedding and decoding said watermark. 

15 32. The MPEG2 moving picture encoding/decoding system as 
set forth in claim 31, wherein the domain, which the user 
can not access directly, is a lead-in domain. 

33. The MPEG2 moving picture encoding/decoding system as 
20 set forth in claim 32, wherein said decoder decreases 

encoding efficiency by embedded digital watermark 
information. 

34. The MPEG2 moving picture encoding/decoding system as 
25 set forth in claim 33, wherein said decoder for carrying 

out said function decreases an error while predicting 
motion of a P and B pictures by embedded digital watermark 
information. 

30 35. The MPEG2 moving picture encoding/decoding system as 
set forth in claim 19, wherein said decoder prevents 
degradation of image quality by embedded digital watermark 
information. 
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36. The MFE62 moving picture encoding/decoding system as 
set forth in claim 35 , wherein said decoder for carrying 
out said function decreases the error while predicting 
motion of the P and B pictures by embedded digital 

5 watermark information. 

37. An MPEG2 moving picture encoder siibstantially as 
herein described with reference to Figure 6. 

10 38. An MPEG2 moving picture encoding method substantially 
as herein described with reference to Figure 6. 

39. An MPE62 picture decoder substantially as herein 
described with reference to figure 7. 

15 

40. An MPEG2 picture decoding method substantially as 
herein described with reference to Figure 7. 



20 



41. An MPEG picture 
substantially as herein 
Figures 6 and 7. 



encoding/decoding system 
described with reference to 




QflBoe 



A^licatiim No: 
CLuoBS seardied: 



GB 9817878.3 
lto41 



Examiner: 
Date of search: 



John Donaldson 
1 December 1998 



Patents Act 1977 

Sean^ Report under Section 17 

Databases seardhed: 



UK ?sSttA Office coUectkms, including GB, EP, WO & US patent specifications, in: 
UK CI (Ed.P): H4F(FRG, FRP, FRT, FRW. FRX) 

Int CI (Ed.$): H04N 5/00, 5/76. 5/91, 5/913, 5/917. 7/00, 7/16, 7/167, 7/169. 7/24, 
7/26. 7/30. 7/32. 7/34. 7/36. 7/46, 7/48. 7/50. 9/00. 9/79, 9/80, 9/804, 
9/808, 11/00, 11/02, 11/04 

Other: Online:WPI 



Documents considered to be rdevant: 



Cat^fy 


Identic of document and relevant passage 


Relevant 
to claims 


X.E 


EP 0869454 A2 


(NEQ. see column 3. lines 39 to 55, column 4, 
line 55 to column 6, line 14 


19, 35, 36 


X.E 


EP 0860997 A2 


(NEQ. see column 15, lines 16 to 39, column 18. 
line 24 to column 19. line 28, column 21, line 18 to 
column 26. line 5 


19, 25 to 
30, 35 to 
36 


X 


US 5659613 


(COPELAND), see column 6. line 1 to column 7, 
line 30 


19, 35, 36 



X DocuowtaiSksiuvUckofixyvd^OTiiivci^ A DocumoA iidktfii« ttclBUlQ^^ 

Y tw..m>«f mH^rarit^ imA nf fawentivfe gep if cnm h iiMd P Doainxat pubfisfaed on or after the deciaicd piMQT ^ 

with (Bie or more oCbtrdocnmcms of same ctfcgocy. tbefifiqgdaieof tfaisuivcQtiaiL 

E Pktem documcapublisM on or after, but inthpriori^ date cu^ 

& Member of the lainc pateat toily than, ihe filing date of ttnsappticatioa. 



An Executive Agpacy of the Department ofTrade and Industry 



